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USER INTERFACE FOR GENERATING PARAMETER VALUES IN 
MEDIA PRESENTATIONS BASED ON SELECTED PRESENTATION 

INSTANCES 

CLAIM OF PRIORITY 

[01] This application claims priority from the following co-pending U.S. 
Provisional Patent Applications: 

[02] 1 . Application Ser. No. 60/271,376; filed 2/22/01, entitled "A System 
and Method for Editing" (client docket 50P4410); and 

[03] 2. Application Ser. No. 60/284,660; filed 4/17/01, entitled "Advanced 
System and Method for Editing" (client docket 50R4639). 

CROSS-REFERENCE TO RELATED APPLICATIONS 
[04] This application is related to the following co-pending U.S. Patent 

Applications: 

[05] 1 . Application Ser. No. 09/665,721 ; filed 9/1 8/00, entitled "System 
And Method For Optimizing The Processing Of Images" (client docket 50N3647) and 

[06] 2. Application Ser. No. 09/691,795; filed 10/18/00, "System And 
Method For Increasing Performance When Compositing Images" (client docket 50N3649). 

BACKGROUND OF THE INVENTION 
[07] Today, digital systems are used to represent and process virtually all 
types of media in commercial, entertainment, educational and other fields. For example, 
visual media such as photographs, movies, video and animations are largely handled in the 
digital domain. Similarly, audio media such as speech, music, sound effects, etc., are also 
recorded, edited, produced, copied and transferred in the digital domain. Other applications 
for digital systems include the growing e-commerce marketplace where buyers can select 
from millions of different products and services online, such as via the Internet. 

[08] Although digital systems provide many benefits, the incredible speed 
and versatility of such systems to access and manipulate media and other information is often 
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overwhelming to a human user. For example, in the visual media areas many types of non- 
linear editing operations can be performed to create a movie or video, or to modify, correct or 
otherwise change image areas or sequences of images. Art directors, graphics designers, 
engineers, producers or other users of computer workstations can perform dozens of different 
operations on any of millions of pixel elements in a typical image or series of images. Such 
operations include color changes, sharpness corrections; visual effects, combinations or 
composites of different images, scene transitions, etc. 

[09] Many of the objects in today's visual media are created digitally in the 
first place. For example, a computer-generated model may be used to represent an object or 
character in a movie scene or still picture. Not only do human user's have complete control 
of the model's shape, color scheme, texture, lighting and movement; but once a scene is 
rendered, the rendered sequence of images can be further modified as described above. 
q [10] The process of creating visual media is multiplied in complexity since 

^ many types of manipulation can affect the outcome of subsequent manipulations. For 

PJ example, a color correction may affect a later chromakey operation, a contrast adjustment can 

€3 

Hj change an anti-aliasing filterj's effect, and so on. Similar layers of complexity exist in 

Jjjj creating and processing other digital media such as audio. 

3 [11] Amidst all of the complexity, a human user must decide which 

P 

0j operations to perform to achieve a desired result. The process of applying operations to 

H» media is often achieved as a change in attributes, or parameters, of the media. For example, 

W 

P an image can have parameters of color components, filter effects, transitions, etc. Each 
^ parameter typically has a single numeric value. Changing the parameter's value creates a 

change in the quality of the image associated with the parameter. Thus, increasing the value 
of a parameter that expresses the amount of red in an image will cause the image to appear 
more red. 

[12] Parameters can be used to describe many aspects of digital media and 
information. Because parameters are a useful way to describe and modify digital media, 
several prior art approaches exist to allow a human user to modify media parameters and to 
present media to a user based on original and modified parameters. 

[13] One approach is to use alphanumeric text to name a parameter and the 
parameter's value. This is useful where a parameter can easily be described with a text label 
and where the effect of modifying a parameter value is intuitive. For example, when intensity 
of color components of an image is specified as a function of red, green and blue (RGB) 
additive colors, the intensity can range from 0 to 100 percent. Thus, a user can type in a 
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value for each of "green," "red" and "blue" fields on a display and have some notion of the 
outcome of modifying the parameter values. Similarly, with audio volume, a "volume" 
parameter can receive a value in percent, decibels, etc. 

[14] Once a parameter or parameters has been modified, the user can direct 
the media to be presented using the new parameters. This can mean an image is redisplayed 
using the new color components intensities or that an audio segment is played back at a new 
volume level. 

[15] Although alphanumeric parameter presentation and modification is 
easily implemented, it is often difficult and cumbersome for a user to work with such an 
interface. This is partly due to the sheer number of different parameters that may be present 
in a media presentation. Also, some parameter labels do not effectively convey an intuitive 
purpose. For example, RGB, luminance and chrominance are parameters that are used to 
describe images. Most users who have not spent a lot of time working with such parameters 
will not be able to accurately predict what effect modifying a parameter will have on the 



fU presentation. This leads to a trial-and-error approach. 

jr|j [16] One improvement over simple alphanumeric presentation and 

Jj modification of parameters is to provide the user with more versatile, graphical, input 

3 controls such as slider bars, radio buttons, knobs, etc. Another approach is to provide the 
£3 

gj user with a curve or curves on a chart or grid. The curves correspond to values of the 

|\ parameter with respect to some other variable, such as time, location, etc. The user can drag 
UJ 

points on the curve to modify the curve. Thus, the user is able to adjust, for example, RGB 
components over time or over image areas without having to specify many values for many 
different points in an image. Other methods of modifying the curves include using math 
functions to modify the curve's behavior, or to use parameterized math functions that define 
the curve and change the curve's parameters (as opposed to the parameters that the curve is 
describing). 

[17] This graphical approach to change the values, or functions, on a curve 
that represents one or more parameters is not without drawbacks. In the first place, a user 
often needs to know which parameter to change just to call up the necessary display and tools 
to change the parameter. For example, a user may decide that an area of an image is "blurry" 
but will not know the parameter to modify in order to make the image less blurry. In some 
cases, a user may not like an image but will not even be able to describe in words exactly 
what is wrong with the image. This is especially true when a team of users is attempting to 
create a media presentation. For example, an art director and digital artist may be . 
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collaborating in making a change to an image. The art director may need to express a change 
to the digital artist but will be unable to do so effectively since the art director typically has 
less knowledge of image parameters and their effects upon the image. 

[18] Thus, it is desirable to provide an invention that improves upon the 

prior art. 

BRIEF SUMMARY OF THE INVENTION 
[19] A system providing a user interface to allow a user to easily modify 
parameters of media presentations such as images and audio. The user selects first and 
second reference instances, such as images. The images are described by parameters and 
parameter values. Differences between the images' parameter/value characteristics are 
identified. The first and second reference images are placed at different points on a display 
screen. By moving a pointer relative to the positions of the first and second reference images, 
a current image is generated that is a combination, or function, of the identified 
parameter/value characteristics. Thus, the user is able to quickly, and intuitively, achieve 
many desired modifications to the media. 

[20] A feature of the invention allows image content to be modified in a 
similar manner. First and second computer model positions, animations, bitmap images, etc., 
can be used and the same technique employed to create many derivations from the selected 
reference images. 

[21] Multiple parameters can be changed concurrently. A user can be 
presented with a list of parameters so that the user can selectively enable or disable 
parameters to be changed. Other features of the invention are disclosed. 

[22] In one embodiment the invention provides a method for varying an 
attribute of a media presentation. The method including accepting signals from a user input 
device to select a first media presentation having a parameter with a first value; accepting 
signals from a user input device to select a second media presentation having the parameter 
with a second value; accepting signals from a user input device to generate a new value; and 
presenting, on the media presentation device, a new media presentation using the new value 
of the parameter. 



BRIEF DESCRIPTION OF THE DRAWINGS 
[23] Fig. 1 A shows a first screen display of a user interface in a preferred 
embodiment of the invention; 



[24] Fig. IB shows the screen display just after a first reference frame has 

been selected; 

[25] Fig. 1C shows the screen just after a second reference frame has been 

selected; 

[26] Fig. ID illustrates the use of four reference images; 

[27] Fig. 2 is a flowchart illustrating basic steps for interpolation of 
parameter values between reference images; 

[28] Fig. 3 illustrates modification of image content; 

[29] Fig. 4A illustrates a computer system suitable for use with the present 

invention; and 

[30] Fig. 4B shows basic subsystems in the computer system of Fig. 4A. 



DETAILED DESCRIPTION OF THE INVENTION 
[31] Fig. 1 A shows a first screen display of a user interface in a preferred 
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fU embodiment of the invention. 

*0 

jy [32] In Fig. 1 A, display screen 1 10 is used to display media presentation 

gij area 112 and control area 1 14. In the present example, media presentation area 112 can be a 

s single image from a sequence of images in a movie clip such as would be encountered in a 

£3 

pq digital video editing, or post-production, system. An example of such a system is discussed 

M> in co-pending patent applications (1) SYSTEM AND METHOD FOR OPTIMIZING THE 

U? 

p PROCESSING OF IMAGES and (2) SYSTEM AND METHOD FOR INCREASING 



PERFORMANCE WHEN COMPOSITING IMAGES, both referenced above. 

[33] Controls 114 may include standard clip displays, menus, transport 
controls, etc. A preferred embodiment of the invention places such controls toward the 
bottom of the screen so that a substantial rectangular portion of the display screen, such as 
1 16, is left free for displays and controls relating to parameter modification. 

[34] In the digital video application, area 112 displays a "current" frame. 
The current frame is frequently changing as frames from a sequence of frames, or clip, are 
displayed in response to user selection. For example, the current frame may be changing at a 
rate of 24 or 30 frames, or images, per second. The user can control the rate of change. 

[35] A user selects a first reference frame by using a user input device such 
as a digitizing tablet, mouse, keyboard key press, touch screen, etc. At the moment of 
selection, whatever frame is the current frame is copied to a predetermined portion of the 
display screen to become the first reference frame. Any parameters associated with the 
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current frame at the time of selection are also copied and stored, or are otherwise identified as 
being associated with the first reference frame. 

[36] Fig. IB shows the screen display just after a first reference frame has 

been selected. 

[37] In Fig. IB, first reference frame 120 is shown positioned at the upper- 
left corner of the screen. Note that reference frames can be at different resolutions, sizes, etc., 
from the selected frame. However, it is desirable that the first reference frame, and 
subsequent reference frames discussed below, accurately depict the original frame from 
which they were created at the time of selection. As a clip is playing and sequences of 
images are displayed in area 112, the user again selects a reference frame. 

[38] Fig. 1C shows the screen just after a second reference frame, or image, 
has been selected. 

p [39] In Fig. 1C, second reference frame 122 is an image that is different, in 

^ at least one parameter, from first reference frame 120. Second reference frame 122 can come 
W from the same, or different, clip as first reference frame 120. Second reference frame 122 can 
ry be a modified form of first reference frame 120 as where an image-modification operation 
^ has been applied to the clip containing first reference frame 120 or where an operation has 

a been applied to the original frame from which first reference frame 120 was created. A list of 

S 

representative operations is shown in Table I. It should be apparent that many additional 
H types of operations are suitable for use with the present invention. In general, the second 
reference frame can be obtained from any image, whether derived from, related to, or 
unrelated to, the image that spawned the first reference image. 

1. Brightness Adjustment control of luminance in RGB and Alpha channels. 

2. Clamp Effect restricts pixel values within determined ranges. 

3. Contrast adjusts the range between brightest and darkest tones. 

4. Convert change pixel types between, e.g., 8 bit, 16 bit floating 

and working. Can also change image types between RGB, 
RGB A and Alpha channel outputs. 

5. Crop allows trimming an image on the left, right, top or bottom. 

6. Dissolve produces an image that is a mixture of input images. 

7. Fade produces an image that is a mixture of an input image and 

a solid color. 

8. Gain adjusts the brightness of individual channels of a image or 

clip. 

9. Gamma adjusts the apparent brightness by altering the middle range 

of brightness. 

10. Invert reverses an image's color and shades so that black becomes 

white, white becomes black, red becomes cyan, etc. 
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11. CMY Graph adjusts the Cyan, Magenta and Yellow channels. 

12. Luma Graph adjusts the luminance of an image. 

13. Monochrome converts a color image into a monochrome image by 

adjusting color saturation in each of the color channels. 

14. Offset adjusts the brightness of the individual channels of an 

image. 

15. Swap RGB A shifts any color channel to become any other color channel. 

TABLE I 



[40] Once first and second reference images have been selected and 
positioned on the display screen, the user can easily modify parameters in relation to the two 
reference images. A preferred embodiment uses a pointer that is manipulated by a graphics 
tablet. In a parameter modification mode, after reference images are selected, the user moves 
pointer 128 between the reference images in the region 130 of Fig. 1C. An interpolated 
image with a parameter value that is derived from parameter values of both the first and 
second reference images, and which is dep endent upon the distance fr om the pointer to the 
*0 first and/or sec ond reference images, is dis nla yedliTarea 1 12. A p referred embodiment 

fU " 

S.\ determines parameter types which are present in only one reference image (i.e., non-shared 
parameters), and parameter types in common between the reference images but which have 
different values (i.e., shared parameters). These identified parameters are used to generate a 
modified parameter set based on the relative distance of the pointer to the reference images. 

[41] Fig. 2 is a flowchart illustrating basic steps for interpolation of 
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m 



hi 
O 

M parameter values between reference images 



[42] In Fig. 2, flowchart 200 is entered at 202 where it is assumed that first 
and second reference images have been selected and are displayed on the display screen in 
accordance with the discussion, above. 

[43] Step 204 is executed to determine whether there are any shared 
parameters between the first and second reference images. In other words, if there are 
parameters of the same type, or name, associated with both the first and second reference 
images, then the check at step 204 is true and execution proceeds to step 210. However, if 
there are no parameters in common, execution proceeds, instead, to step 206. 

[44] At step 206 a check is made to determine whether there are any 
parameters associated with only one reference image. If not, execution proceeds to step 208 
where the routine is exited since there are no parameters to be interpolated between the first 
and second reference images. 
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[45] Returning to step 204, if there are shared parameters with different 
parameter values, step 210 is executed. At step 210, the different values for each shared 
parameter are used to set upper and lower bounds for the interpolation. A preferred 
embodiment provides linear interpolation between parameter value pairs. For example, 
where a first reference image has parameter value, A, and a second reference image has a 
parameter value, B, a linear interpolation can be achieved as C = A + (B-A) * x where C is 
the new parameter value and x varies from 0 to 1 based on a position in relation to either, or 
both of the positions of the first and second reference images. If the pointer is over the first 
reference image then x = 0 and C = A. If the pointer is over the second reference image then 
x = 1 and C = B. If the pointer is midway between the reference images then x = 0.5 and C = 
(A+B)/2. 

[46] When there are multiple shared parameters, the parameters can be 
interpolated concurrently. In other words, multiple new parameter values for a current image 
are determined for multiple shared parameters based on a single position of the pointer. 
Another embodiment can provide a list of the multiple shared parameters to the user. The 
user can then "disable" selected parameters from modification, as desired. The disabled 
parameters, even though shared and having different values, will not be modified. 

[47] Another possibility is to provide for collaboration in parameter 
modification among two or more users. Each user can move a pointer in relation to the same, 
or different, reference images. The two or more users' position selections are then used (e.g., 
by averaging, weighting, etc.) to arrive at a single new parameter value based on multiple 
user selections. This approach can be useful to get a "consensus" value that represents a 
most-popular parameter value such as where the parameter value (or values) are used to 
select a color, facial expression, clothing style (see below), etc. 

[48] Next, a check is made at step 212 for any non-shared (e.g., present in 
only one of the two reference images) parameter types. If there are no non-shared parameter 
types, execution proceeds to step 216. 

[49] If either of the checks at steps 206 or 212 reveal that there are non- 
shared parameters, then step 214 is executed to identify the non-shared parameters and to set 
bounds for parameter interpolation. One of the bounds for interpolation is the value of the 
non-shared parameter. The second bound for interpolation is chosen to be either the high, or 
low, extreme of the non-shared parameter. For example, if a first reference image includes a 
parameter type "fog effect" with a value of 12 where the "fog effect" parameter can have 
values in the range 0-100, the value 12 is used as a first bound for interpolation while the 
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value 100 is used as the second bound. If the pointer is close to , or in contact with, the first 
reference image, the interpolated value is 12. If the pointer is close to, or in contact with, the 
second reference image then the interpolated value is 100. 

[50] Note that multiple non-shared parametersxan be handled in a manner 
similar to that described above for shared parameters. Also, both shared and non-shared 
parameters can be modified at the same time using the same pointer position. 

[51] Next, step 216 is executed as the first step in a loop to determine a 
pointer position and display a modified image in accordance with the pointer position relative 
to positions of the first and second reference images. 

[52] At step 216, a pointer position is obtained. As described above, the 
user can manipulate the pointer position with the user input device or in any manner as is 
known in the art. Next, step 218 is executed to compute interpolated parameter values based 
on the pointer position relative to one or more reference image positions. 

MJ' [53] At step 220, test is made as to whether the user is done creating new 

vO 

fjjl images. If not, execution proceeds back to step 216 where the pointer position can be 

j^y updated and a new modified image is displayed according to the pointer position. When the 

%l user has finished, execution falls to step 208 where the routine exits. 

m 

[54] Any suitable programming language can be used to implement the 
routines of the present invention including C, C++, Java, assembly language, etc. Different 
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M programming techniques can be employed such as procedural or object oriented. The 

UJ 

g routines can execute on a single processing device or multiple processors. Although the 

TO* 

^ flowchart format demands that the steps be presented in a specific order, this order may be 
changed. Multiple steps can be performed at the same time. The flowchart sequence can be 
interrupted. The routines can operate in an operating system environment or as stand-alone 
routines occupying all, or a substantial part, of the system processing. Note that steps can be 
added to, taken from or modified from the steps in the flowcharts presented in this 
specification without deviating from the scope of the invention. In general, the flowcharts are 
only used to indicate one possible sequence of basic operations to achieve a functional aspect 
of the present invention. 

[55] One embodiment of the invention can implement the interpolation 
technique as a library function, operating system feature, toolkit function, add-on, plug-in, 
library routine or other process or subprocess that is accessible from an application program, 
operating system or other software or hardware. In such an approach, the interpolation 
technique can be a procedure that accepts arguments and returns one or more values. For 
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example, one approach is for the procedure to accept two reference parameters, A and B, and 
a distance, x, from one or more of the reference images. The distance, x, can be a distance 
from a pointer position, as discussed above, or it can be a numerical value generated by some 
other function or criterion. The procedure can return C, the new parameter value based on 
linear interpolation, as discussed above. Or C can be based on some other formula, function 
or factors. Such an approach allows a specific user interface to be programmed differently 
for different applications while the availability of a predetermined piece of code, such as a 
toolkit function, can be used by programmers to add functionality to an application program, 
applet, application, etc. 
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\S6) Basic Hardware 

[57] Figs. 4A and 4B illustrate basic hardware components suitable for 
practicing the present invention. 

[58] Fig. 4A is an illustration of computer system 1 including display 3 



fij having display screen 5. Cabinet 7 houses standard computer components (not shown) such 
*D 

fy as a disk drive, CDROM drive, display adapter, network card, random access memory 

\j 

(RAM), central processing unit (CPU), and other components, subsystems and devices. User 

5 input devices such as mouse 1 1 having buttons 13, and keyboard 9 are shown. Other user 

O 

03 input devices such as a trackball, touch-screen, digitizing tablet, etc. can be used. Other 
^ E media presentation devices other than display screen 5 may be used such as projection 
displays, wearable computer monitor (e.g., "dataglass"), etc. In general, the computer 
system is illustrative of but one type of computer system, such as a desktop computer, 
suitable for use with the present invention. Computers can be configured with many different 
hardware components and can be made in many dimensions and styles (e.g., laptop, palmtop, 
pentop, server, workstation, mainframe). Any hardware platform suitable for performing the 
processing described herein is suitable for use with the present invention. 

[59] Fig. 4B illustrates subsystems that might typically be found in a 
computer such as computer 1 . 

[60] In Fig. 4B, subsystems within box 20 are directly interfaced to internal 
bus 22. Such subsystems typically are contained within the computer system such as within 
cabinet 7 of Fig. 4A. Subsystems include input/output (I/O) controller 24, System Memory 
(or random access memory "RAM") 26, central processing unit CPU 28, Display Adapter 30, 
Serial Port 40, Fixed Disk 42, Network Interface Adapter 44. The use of bus 22 allows each 
of the subsystems to transfer data among subsystems and, most importantly, with the CPU. 
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External devices can communicate with the CPU or other subsystems via bus 22 by 
interfacing with a subsystem on the bus. Thus, Monitor 46 connects with Display Adapter 
30, a relative pointing device (e.g. a mouse) connects through Serial Port 40. Some devices 
such as Keyboard 50 can communicate with the CPU by direct means without using the main 
data bus as, for example, via an interrupt controller and associated registers. 

[61] As with the external physical configuration shown in Fig. 4A, many 
subsystem configurations are possible. Fig. 4B is illustrative of but one suitable 
configuration. Subsystems, components or devices other than those shown in Fig. 4B can be 
added. A suitable computer system can be achieved without using all of the subsystems 
shown in Fig. 4B. For example, a standalone computer need not be coupled to a network so 
Network Interface 44 would not be required. Other subsystems such as a CDROM drive, 
graphics accelerator, etc. can be included in the configuration without affecting the 
performance of the system of the present invention. 

[62] Although the invention is described with respect to interpolation 
between two reference images, any number of reference images can be used. For example, 
Fig. ID illustrates the use of four reference images. 

[63] In Figure ID, third and fourth reference images 132 and 134, 
respectively, are shown along with 20, second image 122 and current image 1 12. Picture 140 
is shown at an arbitrary position on the screen. As discussed, the position of pointer 140 with 
respect to one or more of the reference images on the screen is used to create variations, or 
interpolations, of parameter values along the various reference images. A parameter value can 
be determined among three or more reference images by using the distance from the pointer 
to each image as a weighting factor on each image's parameter value. Other functions can be 
employed to calculate a modified parameter value based on reference image parameter 
values. A modified parameter need not be present in all of the multiple reference images. 

[64] Any matter of deriving parameter values based on one or more 
reference image parameter values and the position of pointer 140 with respect to one or more 
of the reference images is possible. For example, where two reference images are used, 
simple linear interpolation of a single distance along a single dimension, such as the 
horizontal, or "axis" direction, is possible. Other approaches can use the relative distance 
between the pointer and one or more images, distances between images themselves in relation 
to the pointer distance, exponential, logarithmic, or other computational approaches. The 
pointer can be positioned anywhere on the screen including the region of current image 112, 
the control surfaces toward the bottom of the screen, etc. Where multi-screen displays are 
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used, the pointer can either be positioned on a different display screen, device, system, etc. 
Where the pointer is moved beyond one or more of the reference images, then extrapolation, 
rather than interpolation, can be used to generate parameter values. In general, any means of 
generating parameter values that uses parameter values of one or more reference images 
along with relative position of a pointer with respect to one or more reference image position 
is suitable for use with this invention. 

[65] Thus, the invention provides a simple way for a user to easily 
manipulate many complicated parameter types by relying on intuitive and easily understood 
visual cues and effects. For example, an art director can select two different contrast settings 
of similar frames in a clip. By simply moving the pointer between the two frames (e.g., 
closer to or further away from a frame of lighter or darker contrast), the desired contrast can 
be instantly, and easily, obtained. Note that this approach works well for many types of 
visual parameter modifications since the image, itself, is usually not considered a parameter. 
In other words, the actual image content in each frame is always changing in a typical movie 
clip. However, the vast majority of parameter settings do not change quickly, or often, 
compared to the image content of the frame. Thus, for example, a frame that is desired to be 
changed can be selected as a first reference image while a second frame that subjectively 
"looks" like it could contribute to a desired modification can be selected as a second 
reference image. The pointer can be moved from the first image toward (or beyond) the 
second image successively until the desired amount of change is achieved. One embodiment 
of the invention provides that when the pointer is moved over the reference image, that 
reference image's parameters are copied exactly into the parameter values for the current 
image. This approach allows libraries of different reference images having basic parameter 
modifications to be saved and called-up for later use. 

[66] The present invention can be used in more than two dimensions. For 
example, a virtual reality display device (or a two dimensional display device used to display 
three-dimensions), can represent three dimensions so that a user is provided with more 
possibilities in selecting position and distances of the pointer and reference images. Other 
input devices can be used such as a data glove, 3D track balls, etc. 

[67] Although the invention has been discussed primarily with respect to 
digital image processing, it should be apparent that digital audio processing, and other types 
of processing, are also suitable with this invention. In the case of audio processing, portions 
of waveforms are typically visually represented on the screen in the manner similar to 
images. The waveform portions can also be represented by icons or graphical images. Each 
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of these visual representations of sound can be handled similarly to reference images, as 
discussed above. When a current audio portion is selected, that audio portion can be visually 
represented in a portion of the screen display such as in the corners. 

[68] With reference to Fig. 1C, first reference audio sample 120 can have a 
first level of reverb as set by a value in a "reverb" parameter. Second reference audio sample 
122 can have a second level of the same "reverb" parameter and can be placed in a second 
portion of the screen display. Modification of the reverb parameter value can be achieved by 
moving pointer 128 between the two visual representations of the waveforms in the region 
130 or by moving the pointer top of, or to the right or left of each reference audio sample. 
Naturally, any other parameter or parameters of audio waveforms can be handled in a similar 
manner. 

[69] Another application of the present invention is to vary image content, 
as opposed to varying operations on image content. In this case, the visual content and 
images should be expressed as a set of parameters, attributes, functions or other 
characteristics that can be identified and varied. 

[70] For example, a computer model, bitmap, animation or other computer- 
based image can be modified in position, shape, style, etc., according to the system of the 
present invention. A model of a human figure can be rendered in different positions on a 
display screen. Instances of the rendering can be selected as first and second reference 
images. Such an approach is shown in Fig. 3. 

[71] In Fig. 3, images 302 and 304 are the first and second rendered 
reference images. Pointer 300 is shown in a position roughly partway between the two 
reference images. The first reference image is a computer model of a human figure showing 
arms in a lower position while the second reference image 304 is a computer model of a 
human figure with arms in a raised position. Since pointer 300 is positioned about mid-way 
between two reference images, the resulting current image 306 is a computer model of a 
human figure with arms halfway raised. As pointer 300 is moved to the right, closer to 
reference image 304, the arms in current image 306 will rise. As pointer 300 is moved to the 
left, closer to reference image 302, the arms in current image 306 will lower. Naturally, any 
other type of animation, movement or positioning of computer models can be manipulated in 
the same manner. This could be particularly useful for facial animations where precise 
placements and relationship between eyes, cheeks, mouths, brows, etc. is very important to 
convey nuances of expression. It should be apparent that many uses of the present technique 
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of manipulating computer models based on reference images and pointer positioning are 
possible. 

[72] The invention is also applicable to series of images, or clips. For 
example, in Fig. 1C, first reference image 302 and second reference image 304 can be clips 
of a few seconds of a figure running. The clips can be looped for continuous playback. First 
reference image 302 shows the figure running with arms lowered while second reference 
image 304 shows the figure running with arms raised. The positioning of pointer 128 causes 
clip playback in the current image 306 to exhibit behavior similar to that with the static 
image, discussed above, except that the figure is shown in an animated run. The use of clips 
allows an animator, modeler or other user to create more lifelike animations. 

[73] Yet another application of the present invention includes modifying 
images by swapping bitmap portions. For example, a problem with purchasing goods over 
the Internet is that a consumer is not able to adequately observe the article being purchased 
before the purchase must occur. This is particularly problematic where the consumer is 
buying goods such as clothes, manipulable articles of manufacture, etc. One application of 
the present invention would allow consumers to pick first and second (or more) reference 
images such as a dress with images of long and short hemlines. The pointer is moved 
between the two images to achieve the desired hemline. Similarly, colors of articles or other 
design nuances can be varied. For example, a low or high collar, narrow or wide lapel, tie, 
hat brim, etc. can all be varied based on selections of two different images. Note that as long 
as each of the qualities of clothing are expressed in attributes or parameters (or other forms of 
mathematical or data description), multiple different parameters can be changed easily so that 
one article of clothing can be made to adopt characteristics of another. The consumer can 
select the appropriate level of characteristic adoption and notify the seller that they are 
interested in such an article. The seller can then find the closest match to the consumer's 
preferred parameters within the seller's inventory and supply the seller with that article. 

[74] Although the present invention is described predominantly with respect 
to a visual image processing system, many types of systems that include media presentation 
features can employ the present invention. Such systems include, but are not limited to, 
audio, animation, modeling, computer-aided design, web browsing or access, etc. 

[75] Although the invention has been discussed in connection with 
parameters and parameter values, other structures for modifying media instances, such as 
attribute/value pairs, arrays, lists, etc., can be employed. In general, a parameter, or other 
data structure, used to describe an image need not only have a single value. Multiple values, 
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data structures, functions, etc., can be used to define parameter values either continuously or 
discretely. For example, where a function is used to define parameter values over space, 
time, etc., the present invention can check for different functions associated with shared 
parameter types as opposed to merely checking for different values, as described above. 

[76] Although screen displays such as 1A-D illustrate the invention in 
connection with a digital editing system, many other applications are possible. Other 
embodiments need not devote screen area to specific controls, such as the controls at 1 14 of 
Fig. 1 A. It should be apparent that the entire screen, or different portions of the screen, can 
be used for media presentation and parameter modification as described herein. 

[77] Note that the presence of visual indicators for the reference 

images is not strictly necessary. For example, a user can select first and second reference 
images and the images need not be shown in positions on the display for interpolation to 
occur. The positions of the reference images can be understood to be in, e.g., the top-left and 

O 

41 top-right corners, or anywhere else. The user can merely move the pointer across an area 
pj predefined to be used as the interpolation area, with or without the display of reference 

*0 images, and a current image can be modified according to the details discussed, above. 

fU 

SJ [78] Thus, the scope of the invention is to be determined solely by the 



appended claims. 
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